CHARACTERIZATION OF MODULATION SPACES BY NONLINEAR 

APPROXIMATION 



S. SAMARAH AND S. AL-SA'DI 



Abstract. It is shown that the modulation spaces M™ can be characterized by the ap- 
proximation behavior of their elements using Local Fourier bases. In analogy to the Local 
Fourier bases, we show that the modulation spaces can also be characterized by the ap- 
proximation behavior of their elements using Gabor frames. We derive direct and inverse 
approximation theorems that describe the best approximation by linear combinations of 
N terms of a given function using its modulates and translates. 



1. Introduction 

One of the central problems of approximation theory is to characterize the set 
of functions which have a prescribed order of approximation by a given method of 
approximation. Results of this type are known and easy to prove if we work in 
a Hilbert space and the set where the approximation is seeking is an orthonormal 
bases. 

For general systems, there are sufficient conditions on a given function in the 
space which guarantees certain rate of decrease for the error of approximation. In 
this paper we consider the method of nonlinear approximation in particular spaces 
called the modulation spaces. We investigate the approximation of smooth functions 
by time-frequency shifts. The method of nonlinear approximation has recently found 
many computational applications such as data compression, statistical estimation or 
adaptive schemes for partial differential or integral equations. 

Nonlinear approximation is utilized in many numerical algorithms, it occurs in 
several applications. In mathematics and applications it is very important to write 
a function in some function space in the form 

f = ^2 Xk9k 

keA 

where A is an indexed set and {<?/% : k € A} is a set of functions. The case in which 
this set is obtained from a single function is very interesting. One way to construct 
such set is by using the Gabor frames. Here we characterize functions with a given 
degree of nonlinear approximation for a given function / belonging to some specific 
space using its modulates and translates. 

Let X be a Banach space, with norm 
11-11 = ll-ll A'- Then we say that a subset T> of functions from X is a dictionary if : 

(1.1) for all g € T>, \\g\\x = 1 ; o,nd g € T> implies — g £ T> 
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Let £at(2?) be the set of all functions in X which can be written as a linear 
combination of at most N elements of T>, i.e., 

(1.2) Z N (V) = {s G X; s = c k9k , 9k G V, c k G C, card{F) < N} 

keF 

From this definition we note that the sum of two elements from S^r is generally not 
in Ejv, which means that the space S^v is not linear. 

For any given /, the error associated to the best iV-term approximation to / from 
T> is given by: 

(1-3) a N (f,T>) x ■= cr N (f)x = inf ||/ - s\\ x 

The method of nonlinear approximation was first used by Stechkin; he charac- 
terized the space of all / G ^(K) which have absolutely convergent orthogonal 
expansion, see [Q. More precisely, he proved the following theorem: 

Theorem 1.1. Let {4>k] k G N} be an orthonormal basis for L2(M) . Then for 

f G L2(M) we have: 

oo _. 
fceN N=l 

For a general discussion of the characterization problem, DeVore and Temlyakove 
made a modification of Stechkin's result to characterize other approximation spaces: 
For a general dictionary T>, and for any p > define 

A° p {V,M) = {f EH; / = ^«,ii) fe £P, |A|< oo and (j^M*] ^ M } 

keA VfcgA / 

and we define A p (V,M) as the closure (in Ti) of A°(X>,M). Furthermore, define 

A p (V)= |J A p (P,M) 

Af>0 

and for / G A p (V) the semi-norm \f\A p (v) is the smallest M such that / G 
A P (V,M). 

Let 2? be given by an orthonormal basis k G Z}. Then / G ^4 p (D) if and 
only if J2k \ {f^k)\ p < oo and 

\f\MV)= fEl^^)l P ) • 
Vfcez / 

It means that we can characterize certain approximation orders by the spaces A p . 
So, Stechkin's result in Theorem l|l.l|) can be formulated as follows: 

oo ^ 

/ G Ai{V) if and only if ]T {N l ' 2 a N {f, V))- < oo. 

AT=1 

A slight modification of Stechkin's result due to DeVore and Temlyakov is given in 
the following theorem. 
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Theorem 1.2. (2 J. If V is given by an orthonormal basis for TC, for a > and 

p = (a + , we have : 

(1.4) fEA p (V) ^ J2(N a a N (f)Y-<oc. 

N=l 

This theorem provides a characterization of functions with an approximate order 
like 0(N~ a ), for a = - — using an orthonormal basis, and as a special case, 
setting p = 1 we get Stechkin's result. We are now interested in characterization the 
approximation space A P (T>) in the whole range of the parameters a,p and a given 
dictionary T>. 

2. Gabor Frames and Modulation Spaces 

In this section we will collects the necessary information the Gabor frames and 
modulation spaces. The modulation spaces occur in the study of the concentration 
of a function in the time-frequency plane. They were introduced in 1983 by H. 
Feichtinger [3j and were subsequently investigated in [IJ |5] . These spaces are defined 
by the decay properties of the short time Fourier transform, and contain many 
classical function spaces. 

In addition to the basic definitions and notations of [S] , the Schwartz class and the 
space of tempered distributions on R are denoted by <S(R) and 5'(R) respectively. 
The translation and modulation operators are defined, respectively, by: 

(2.1) T x f(t) = f{t-x) and M w f(t) = e 2wiwt f(t) 

for x,w G R. The Short-Time Fourier transform (STFT) of a function / S L 2 (R) 
with respect to a function g € L 2 (R) called the window function, is defined as: 

(2.2) V g f(x, w)= [ f(t)g(t - x)e~^ iwt dt = (/, M w T x g). 

JR 

A submultiplicative weight function v on R 2 which is a positive, symmetric and 
continuous function and satisfies 

(2.3) v{z\ + Z2) < v(zi)v(z2), for all Z\,Z2 <G R 2 . 

An v-moderate weight function m on R 2 which is a positive, symmetric and contin- 
uous function and satisfies 

(2.4) m(z 1 + z 2 ) < Cv(z 1 )m(z 2 ), for all Zi, z 2 G R 2 . 

For any continuous strictly positive function m on R, the weighted L p space L™(R) 
is defined by the norm 

Ml™ = \\fm\\ Lp 

and the mixed-norm spaces (R 2 ) consists of all (Lebesgue) measurable functions 
on R 2 , such that for a weight function m on R 2 the norm 

\ ilv \ 1/9 

(2.5) \\F\\ L ru q = \ I ( / \F(x,w)\ p m{x,w) p dx ) dw) 
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is finite. Throughout this paper, we will use two types of weights: 

Given a non-zero window function g € L2(M.) and constants a, (3 > 0, the set of 
time-frequency shifts 

(2.6) G{g,a,P) = {T ak M Pn g- k,n£Z} 

is called a Gabor frame for L2QR) if there exists constants A, B > (called frame 
bounds) such that for all / € ^(K) 



(2-7) A\\f\\\ 2 < £ \(f,T ak M Pn g)\ 2 < B\\f\\l 2 

Under stronger assumptions on the function g, the expansion in equations (??) 
and (??) are valid not only in Li but in the entire class of function spaces, namely, 
the modulation spaces. 

Definition 2.1. ( 6 ]). Fix a non-zero window g E 5(M), a v-moderate weight 
function m on M 2 , and 1 <p,q< 00. Then the modulation space M™ q (R) consists 
of all tempered distributions / £ <S'(M) such that 

(2.8) \\f\\ M rn q = \\V g f\\ L ™ = ( [ ( [ \V g f(x,w)\Pm(x,wTdx) q/P dw) 



is finite. 



Thus, M™ q is a Banach space of tempered distributions. If p = q, then we write 
M™ instead of M™ p , and if m(z) = 1 on M 2 , then we write M m and M p for M^ q 
and Mp, respectively. Some examples of modulation spaces are the following: 

(1) The Segal algebra S (R) = M 1} i(R). 

(2) L2(M) = M2 2(K). However, L p does not coincide with any modulation space 
when p 7^ 2 [7j . 

(3) The Bessel potential space: 

tf s (M) = {/ e 5'; II/Hh. = (/ K l/HI 2 (1 + lu;! 2 ) 2 ^^) 172 < 00}. 



Theorem 2.2. (|E]j. £ei m be a v-moderate weight. Then 

(1) (R) is a Banach space for 1 < p, q < 00. 

(2) is invariant under time- frequency shifts, and HT^M^/Hjym < Cv(x, w)\\f\\Mp 

(3) 7/1 < Pi,P2,Qi,Q2 < °o and 7712 < Cmi, i/ien 

M™ 1 ^ C M™f g2 , w/ienewer pi <p 2 ,qi < q2- 
Moreover, there exists a constant C such that 

( 2 - 9 ) 11/11*33, 2 < ^II/Hm- x 

/or allfeM™i qi . 

The appropriate window class in this setting is the Feichtinger algebra 
M? = {feS'(R) : V//a?(l 2 )}. 
where v is a submultiplicative weight on R 2 with polynomial growth. 
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Theorem 2.3. (IB] J. Suppose 1 <p,q< oo, m is a v-moderate, 5,7 6 MJ'. Suppose 
that {M-fSnTakg, k,n £ Z} generates a frame for L2(K), then for all f £ M™ q we 
have 

(2.10) / = J2J2<f' M ^ T ^k9)M 0n T akl 

(2.11) = ^^(/,M /3n T Qfc7 )M /3n T Qfc9 

with unconditional convergence in M™ ifp,q < 00, and weak-star convergence in 

1 lv 

Moi otherwise. Furthermore, there are constants A,B>0 such that for all f € 

(2.12) AWfUj^ < (j2 (j2\(f,MpnT ak g)\ p m(ak,/3n)A \ < B||/|| M ™ 



ill" 1 
p,q 



And the norm equivalence: 

(2.13) A'\\f\\ M ^ q < fa (^2\(f,MpnT ak yW m(afc,/3n)^ j < B' 
ZioWs on M™. 

3. Characterization of Modulation Spaces M p 

According to the definition of the approximation spaces A P (T>), several ques- 
tions arise: 

(1) IfDis given by the Fourier basis, what is the space that can be characterized 
by this basis ?. 

(2) IfDis given by a Local Fourier basis, what are the spaces that can be char- 
acterized by this basis ?. 

(3) // D is given by Gabor frame, what are the spaces that can be characterized 
by this basis ?. 

The first question was answered by Stechkin in Theorem Q1.1JI . For the second 
question we have the K. Grochenig and S. Samarah result [5]. 

Theorem 3.1. (8j. If0<p<q<oo and a = - - -, then: 



p <?' 

00 



(3.1) / € M™ if and only if ^ {N a a N (f) M ^) P ^ < 00 

N=l 



In the proof of Theorem (|3.1|) the basis property was used in an essential way 
to rewrite the approximation error in terms of a sequence space norm. For linearly 
dependent sets it is not clear how much of Theorem (|3.1|) still holds. The next 
theorem prove the one-half of Theorem H3.1|) under the weaker assumption that the 
set {T^M^^ :m,n£Z} isa Banach frame for M™. 
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Proposition 3.2. Let {T^MLyn^ : m, n G be a Banach frame for M£ 

for all < p < oo. // < p < q, a = ~ - | and f G M^, tften 

oo 

(3-2) £ (iW JV (/) M .) P -<oo 

AT=1 

Proposition (j3.2() does not give a complete characterization of the modulation 
spaces M p using the Gabor atoms as a dictionary. It proves only that for a function 
/ in a modulation space M p , the approximation error has order N~ a , but does not 
give the other implication, i.e., if the approximation error for some function has order 
N~ a for some a > 0, what does this tell us about the space to which / belongs. 
This inquiry will be answered in our next work which will based on the classical 
inequalities of Jackson and Bernstein where we applied with the Gabor atoms in the 
modulation spaces. 

Let X be a Banach space in which approximation takes place and assume that 
we can find a number r > and a second space Y continuously embedded in X, and 
X n be the subsets of X in which approximants come from. Then 

Jackson Inequality: o~ n (f)x < C n~ r |/|y, for all / G Y, n = 1, 2, 

Bernstein Inequality : \s\y < C n r ||s||x, for all s G X n , n = 1,2, 

Our claim now is: Assuming that the modulation space is the space in 
which approximation takes place, and using Stv as the subset of X in which the 
approximants are seeked. Then Bernstein inequality holds for our working space. 
Before proving our new result let we define £tv using Gabor frames as follows: 

(3.3) E N (V) = {s G M^; s = ^ c kn T ak Mp n g, c kn G C, card(F) < N} 

(k,n)eF 

Proposition 3.3. Let l<p<q<oo,a>0 and g G Mi , letV := {T a kM.p n 9, k,n G 
Z} be a dictionary given by a Gabor frame for L2(R), and for a = (| — |) + 1- Then 
we have: 

(3.4) If seZ N (V), then \\s\\ Mp < C N a \\s\\ Mq ViV = l,2,.... 
for some positive constant C := C(a,(3,g). 

Proof. Let s£Sjy which has a Gabor expansion: 

(3-5) S = ^ CfcnTafcM^Sf, 

for some indexed set F with card(F) < N and some coefficients Cfc n! and for sim- 
plicity of notations we let g kn = T ak M.p n g. Taking the M p -norm for s and using 
formula ()2.8|) we have: 
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and applying the Holder's inequality for Y^(k,n)eF \ c knV 9 gkn(x, y)\, for 1 < p < oo, 
and using the fact that q' < p' we get 

i/p / / \ P \ 1 /p 

W 



|*[|M P < E W • / / [ E l^n(*,2/)| 9 ' 

\(Jfc,n)eF / I V (Jfe,n)eF 



1 , , 1 



< Np( sup \c kn \).N7\ / / ( sup |V 9 fi(fc n (x,y)|) ctedy 

(k,n)£F \JRJR (k,n)eF J 

= Np~* +1 .( sup |c fen | ) .\\V g g k > n r\\ Lp , for some (k',n f ) e F 

{k,n)£F 

< ATp~9 +1 .( sup \c kn \) . C \\g\\ Mp 

(k,n)eF 

where we used part (2) of Theorem (|2.2|) in the last inequality. Now, since g £ Mi 
and 1 < p < 00, then ||<7||a/ p < IMImi which is finite. Moreover, Since s € M^, 
Theorem 1)2.3(1 implies that there exist constants A, B > (depends only on a, /3 
and g) such that for p = q = 00 we have 

\\s\\m v <C'.N^ +1 (B.\\s\\Mj.\\ghh 
Furthermore, we know that ||s||moo — II s IIm ? for 1 < q < 00, hence 

IN|m p <CNp 1 \\s\\ Mq 
for a constant C independent of s, which completes the proof. 

□ 

Remark 3.1. (^01)- By the monotonicity of the sequence (o~N(f)M q ), we have 
the following equivalence relation: 

(00 \ V A / 00 \ V A 

E i Na ^(f)M q ] x j,) * E [( 2N r*Mf)M q ] x ) 
N=l J \AT=0 / 

for each a > and < A < 00. Furthermore, this equivalence means that there 
exists finite constants A%, A 2 > 0, such that 

/ 00 \ 1 / X / oo \ 1 / x 

a, e [^m/)m,] a ^ < E [(2 w r^(/)Mj A 



\AT=1 / \N=0 



< A 2 E [^^(/)mJ A ^ 



A 1 \ 
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Theorem 3.4. Let {T^M^ng; k,n G Z} iie a Gabor frame for L 2 (M) ; X/v as 

I _ I 



defined in \3. °J\) . 1 < p < q < 00, and a = i — - + 1. T/ien uie /mi>e 



00 ^ 

(3.7) i/ ^ (iWjv(/)M 9 ) ]y < 00 t/ie ™ / G M p . 

JV=1 

Proof. Given a function / belongs to the modulation space and has a Gabor 
expansion 

/ = AfenTcfclVI^g 

for some window function g G Mi. Moreover, suppose that the approximation error 
of approximating / by elements from S^r is measured in an Mg-norm and satisfies 



£ [N a a N (f) Mq }^\ <oc, 

.N=l / 



(3.8) 

for any a > 0, and 1 < p < 00, we need to show that ||/||m p < 00 • 

For all N G N, let sn G S 2 jv be a near-best approximant to / from S 2 jv, i.e., 

( 3 - 9 ) 11/ - s Nhi q = o- 2 N(f) Mq 

Furthermore, we can assume that every / in can be written as 

k 00 

/= lim }(sn - Sjv-i) = /Xsn - sjv-i) 

k >oo *■ — * ^ — * 

N=l N=l 

where so = 0. Now, taking the M p -norm for / we get 

00 

(3-10) ||/||m p < \\*n - sn-i\\m p 

N=l 

Since E 2 jv-i Q E 2 jv. Then (sjv — sat_i) G £ 2 jv. So we can apply our result in 
Proposition (|3.3j) for (sjy — s/v-i) as follows: There exist C > such that 

(3.11) \\s N - s N -i\\m p < C(2 N ) a \\s N - s N -i\\M q 
for the given a > 0. 

Moreover, from assumption (|3.9|) and from the monotonicity of {o~N{f)M q ), we 
have 

(3.12) || sjv — Sjv-i||jw„ < C a 2 N-i(f)M q , for some constant C > 0. 
Back to Equation (|3.10|) . using the previous inequality, we have, 



i P <C' 2 J2 [(2 N ) a o- 2 Hf)i 



\M P 

N=0 

Using Remark (3.1) for A = 1 and our assumption in ()3.8|) above we get 



A/ p <Cq £ [N a a N (f) Mq ]±) <oo 

\N=1 J 
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Thus, our proof is complete and we have ||/||a/ p < °0) i-©-> / € M p . □ 

4. Characterization of Modulation Spaces M p q 

Now it is natural according to the later results that one thinking in the 
characterization of the modulation spaces M Piq using the Gabor frames and nonlinear 
approximation, and if it is possible to characterize an arbitrary function / belonging 
to some modulation space like using elements from the same space, knowing 
that its approximation error measured in the M P)(J -norm satisfying some condition. 

Let T> := {T a k^-/3n9] k,n € Z} be a dictionary given by a Gabor frame for L/2(M), 
and define for all N £ N: 

(4.1) Ejv(P) = {«e Moo; s = Yl c knT ak M/3 n g, c kn G C, card(F) < N} 

(k,n)eF 

(4-2) M/)m m = mf \\f-s\\ Mp , q 

We can solve this problem in one direction. More precisely, for defined in 
Equation (|4.1|) . we have 

Theorem 4.1. Let {T a jfcM^ n 5; k,n £ 7*} be a Gabor frame for L2(M), Sjy as 
defined in Equation 1 < p\ < p < 00, 1 < q\ < q < 00, and a = (— + i) — 

(i + |) + 2. Tften, 

00 

(4.3) i/ S (^ a M/W„„) ^ < «), t/ien / e M Pl)9l 

2V=1 

Before starting the proof of the theorem, we must show that the Bernstein esti- 
mate theorem can be applied to these modulation spaces under our new definition 
of and a given rate a > 0. 

Proposition 4.2. (Bernstein Inequality and Modulation Spaces M Piq ). 
Let 1 < pi < p < 00, 1 < qi < q < 00 and a > 0. Let g £ M\, and T> : = 
{T ak M./3 n g; k,n G Z} 6e a dictionary given by a Gabor frame for L2OR). Then for 

a = (i + s-) " + J) + 2 ' ™ e W; 

(4.4) »y a , i/ien ||s|U w < CiV" ||s|| Mp , g , VJV = 1, 2, .... 
/or some positive constant C := C(a,f3,g). 

Proof. Let s € S^v- Then 

(4.5) s = CfeTajM^g = CteT^M^g 

(fc,n)G-F fe « 

for some indexed set F with card(F) < N and some coefficients Cfc n . For simplicity 
of notations we let g kn = T a kM./3 n g. Now, taking the Mp li(J1 -norm for s and using 
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formula (|2.8|) we get 



\qi 



\\V 9 s 



|9i 

I Lr, 



< 



EE \ckn\\Vg9kn{x,y)\ 



k n 



Pi \ <?i/Pi 



dy 



Now, keeping in mind that we are working over a finite indexed set F, using the 

Holder's inequality over the internal index, and h —r = 1, we have for each x,y 

pi Pi 



E EMI v ^fcn(z,y)| <E (E 



IPi \ P 



r .(El v ^n(x,y)| p,1 ) pi 



Again, using the Holder's inequality over the external index, and — + = 1, the 
right hand side of the last inequality will be less than or equal to 









( 




(4 ' 6) (? 


^ ^ |cfcn| 




E 


E \Vg9kn{x,y)\ Pl 








V k 






Now, simplifying the first part of the expression in (|4.6|) . we get 



E 



^ I I 



— +— 

<Nn 'I. ( sup |c fc J 



(fc,n)GF 



But since pi < p, then < p[, so 



[El V ^n(x,y)| p,1 ] 1/Pl < [EI V ^«( X '^| J 



and we get 



E 



V 



E I v g5ifcn(^,y) 



Pi 



q i \ i\ 



< 



E 



sup (Vg^^y) 



< N7 l^2\V g g kn/ (x,y) 



Since q\ < q, we must have q' < q[. Hence we get 

1M 



( E \ V g9kn'(x,y)\ qi 



< ^E \ v g9kn'(x,y)\ q ^ 
= N7\V g g k ' n >(x,y)\ 



l/q' 
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Therefore 



\Pi 




i h In 
Combining our results we get 

/. \ /. \ \°kn\\ Vg9kn (x, y) 



<N 2 - { T^\V g g k , n ,(x,y)\ 



\ s \\M P1 , qi < 



k n 



Pi \ Ql/Pl 

dx dy 



i 

n 



E \ v g9kn{x,y)\ Pl 



< N { n + n ] { l + « )+2 . sup \c k% 




Ql/Pl 



dy 



V 9 gk'n'{x,y)\ pi dx 



(k,n)£F 

Using Equation (J2.8|) and Theorem (|2.3j) for p, q < oo we have 



91 1 Pi 



dy 



s M 



(^- + ^-)-( i + ! )+2 



< CiV ( ^ + i ) - ( p + i )+2 . || S || M || 5feV || Mp 



for some positive constant C := C(a, (3, g). Moreover, using part (2) of Theorem 
2.2J) and our assumption that g € M\ and 1 < p%, q\ < oo we get our result. □ 



Proof of Theorem (j4.1jh 

Given a function / belongs to the modulation space and has a Gabor expansion 

/ = ^2 AfcnTafcM^g 

fc,n£Z 

for some window function g E Mi . Suppose that the approximation error of approx- 
imating / by elements from Sjv is measured in an M Pi9 -norm and satisfies 



(4.7) 



vJV=l / 



we need to show that ||/||M P1 , qi < °o- 

Let sn £ S 2 iv be a near-best approximant to / from T, 2 n, for all N 6 N, i.e., 

( 4 -8) ||/ - Sjv||iW- p , 9 = cr 2 N{f) Mp , q 

Since every / in can be written as 



/ = Y( S N ~ SJV-l) 
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where so = 0. Taking the M pi)9l -norm for / we get 

oo 

( 4 -9) 1 1 /Haw < Yl W SN ~ s ^-ilk Pll91 

N=l 

Since (sn — sn~i) G S 2 i\r. So, from Proposition (|4.2|) . there exist C > such that 

(4.10) \\s N - s N -i\\M n , n <C(2 iV ) Q || SJ v-sjv-i||M Pj , 

for the given a. Moreover, from assumption (|4.8|) and from the monotonicity of 
(<?N(f)M p J, we have 

(4.11) \\s N - sjv-illAf,,,, < C a 2 N-i (f)M p , q , for some constant C > 0. 
Back to Equation (|4.9j) . and using the previous inequality we have, 



<c 2 E i( 2N r^(f)M M ] 

N=0 

and using Remark (3.1) for A = 1 and our assumption in 1)4. 7 Jl above we get 

< oo 



W=l / 



Thus, ||/||m p1 , w < oo, and / G M pi>qi . □ 
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